Enhanced Vision for All-Weather Operations under NextGen 


Randall E. Bailey.* Lynda J. Kramer, and Steven P. Williams 
NASA Langley Research Center. Mail Stop 152. Hampton. VA 236X1 


ABSTRACT 

Recent research in Synlhctic'Enhanced Vision technology is analyzed with respect to existing Category II III 
performance and certification guidance. The goal is to start tire development of performance-based vision systems 
technology requirements to support future all-weather operations and the NextGen goal of Equivalent Visual 
Operations. This work shows that existing criteria to operate in Category III weather and visibility arc not directly 
applicable since, unlike today, the primary reference for maneuvering the airplane is based on what the pilot sees 
visually through the "vision system." New criteria are consequently needed. Several possible criteria are discussed, 
but more importantly, the factors associated w ith landing system performance using automatic and manual landings 
are delineated. 

Keywords: Synthetic Vision. Enhanced Vision. Enltanccd Flight Vision System. Head-Up Display. Aviation 
Safety. Flight Deck Systems. All Weather Operations 

I. INTRODUCTION 

The U.S. air transportation system is undergoing a transformation to accommodate a projected threefold increase in 
air operations by 2025.' One of the key capabilities envisioned to achieve this Next Generation Air Transportation 
System (NextGen) is the concept of equivalent visual operations (EVO). EVO implies the capability to achieve or 
ev en improve on the safety of current-day Visual Flight Rules (VFR) operations, maintain live operational tempos of 
VFR. and perhaps even retain VFR procedures - all independent of the actual w eathcr and visibility conditions. 

One significant challenge to the EVO concept objective is the definition of required equipage on the aircraft and on 
the airport. With today's equipment and regulations, significant investment is required in on-board equipment for 
navigation, surveillance, and (light control and on the airport for precision guidance systems and approach lighting 
systems for “all-weather” landing capability . The levels of equipment redundancy, capability, maintenance, and 
accuracy dramatically increase as landing visibility minima decrease. EVO implies "Category Ilf' operational 
capability to all runway thresholds. Synthetic Vision (SV) and Enhanced Vision (EV) offer a means of prov iding 
this capability w ithout significant airport infrastructure investment. 

The Integrated Intelligent Flight Deck (IIFD) project,* under NASA's Aviation Safety Program (AvSP). is 
investigating the use of sy nthetic and enhanced vision (S'EV) as enabling technologies to meet the challenges of 
EVO. creating a virtual visual flight environment for the flight crew, independent of the outside weather and 
visibility conditions. In this paper, recent research in S'EV technology is analyzed with respect to existing Cat Il/lll 
performance and certification guidance to identify how Si'EV technology may suppoit future all-weather operations 
ami the NextGen goal of EVO. 


2. BACKGROUND 

SV is a computer-generated image of the external scene topography, generated from aircraft attitude, high-precision 
navigation, ami data of live terrain, obstacles, cultural features, ami Oliver required flight infomiation. EV is an 
electronic means to provide a display (typically on a head-up display, or HUD) of tlvc external scene by use of an 
imaging sensor, such as a Forward- Uooking InfraRcd (FLIR) or millimeter wave radar. Both SV and EV' are 
"vision-based” technologies intended to create, supplement, or enhance the natural v ision of the pilot. 

NASA ami others have developed and shown SV technologies to provide significant improvements in terrain 
aw areness ami reductions for the potential of Controlled-Flight-Into-Terrain incidents/accidents, 1 ' 5 improvements in 
flight technical error to meet Required Navigation Performance criteria." and improvements in situation awareness 
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(SA) vviiltoui concomitant increases in workload compared to current generation cockpit technologies’ 1 ' As such, 
SV is emerging as "standard equipage" for Part 23 and Part 25 business and general aviation aircraft flight decks 
even though, to date, no "operational credit" is obtained by SV equipage. 

EV capability on a HUD using FLIR sensor technology has also carved out a significant share of the business 
aircraft market. EV pros ides many of the same operational benefits as SV technology, but it uses a direct view of 
the external environment, independent of the aircraft navigation solution or database. Tlvese differences, in pair, 
enable operational credit by use of an approved EV. In 2004. Chapter 14 of the Code of Federal Regulations (CFR) 
Section §91.175 was amended such that operators conducting straight-in instrument approach procedures (in other 
than Category II or Category 111 operations) may now operate below the published Decision Altitude | DA). Decision 
Height (DU) or Minimum Descent Altitude (MDA) when using an approved Enhanced Flight Vision System 
(EFVS) shown on the pilot's HUD. (EFVS is the terminology adopted by the F.AA to indicate the operational 
application of an Enhanced Vision System.) 

Enhanced flight visibility is defined in the Federal Aviation Regulations (FARs) as "the average forward horizontal 
distance, from the cockpit of an aireraft in flight, at which prominent topographical objects may be dearly 
distinguished and identified by day or night by a pilot using an enhanced flight vision system." The concept adopted 
under the rev isions to $91,175 of the FARs is that an EFVS. prov iding enhanced flight visibility, can be used in lieu 
of the required natural vision from the DAOHMDA to 100 ft height above the touchdown /one elevation lTDZE). 
Minimum aviation system performance standards are now available (RTCA DO-315'*) and FAA Advisory Circulars 
(AGs) are emerging which provide guidance for SV and EV technologies with these operational capabilities. 

The diverging challenge for NextGen - and the subject of NASA research - is to develop perfonnanec-based 
standards for SV and EV technologies that go beyond tlvese initial steps toward EVO. Tlve first part of this challenge 
is the dev elopment of performance-based staivdards for all w eather approach and landing. 

In this context, a "vision system." derived from Synthetic and'or Enhanced Vision equipment, is defined for 
generality. The "vision system" (VS) is an electronic means of displaying visual flight references (terrain, obstacles, 
and operations-critical navigational and situational references) on electronic cockpit display! s) for the flight crew, 
integrated with conformal symbology providing important situation, guidance, and'or command information as 
necessaiy and/or appropriate to enable all weather approach and laivding operations. 

Several points of emphasis are important within this concept: 

• The term VS refers to a system, regardless of source or technology, providing an electronic means of 
continuous visual-like information for the pi lot' flight crew. Under current FAA regulation, only EV 
technology is pemvitted. hut in future operations, this distinction may not he appropriate. 

• A critical component of tlve system perfomvance is tlve integration of the "visual-like'’ imagery with 
symbology. Under the current EFVS requirement, the FLIR imagery is integrated with an ineitiul flight 
path marker and flight path reference cue to fonvv guidance for the pilot where the integrated picture shows 
the current flight path and the aireraft position and tlveir projection to the point of intended laivding. This 
use of "scene-linked symbology" - where these symbolic references are located such that they oveilay a 
real-world position aivd move aivd transform as though they were actual objects in tlve world - facilitates 
efficient cognitive processing aivd mitigates problems of attentional tunneling and symbology fixation. 14 15 

• The primary reference for maneuvering the airplane is based on what the pilot secs through the VS. As 
such, the required visual references must he continuously aivd distinctly visible aivd identifiable by the pilot. 

• The only display clement certified under the new $91,175 EFVS rule is a HUD but provisions for ''an 
equivalent display" are also included. What constitutes an equivalent display is not defined, but the display 
must present "the required features aivd characteristics such that they are clearly visible to the pilot flying in 
his or her normal position aivd line of v ision looking forward along the flight path." 

Under $91,175(1). to operate below the DA'DH or MDA. the visual references for the intended runway that must be 
distinctly visible and identifiable are slvown in Table I for operation below the DA'DH or MDA and then, for 
operation below 100 ft Iveight above TDZE. 



Table I: Required Visual References per 14 CFR 91.175 


Required Visual References t une an Enhanced Eliuhl Vision System (14 CFR $91,175(1)) 

Tor operation beUm I). V 1)11 »>r MDA 

Descent below 1D0 feet height above TDZE 

The following visual inferences for the intended runway must 

The following visual references for the intended runway 

be distinctly visible and identifiable: 

must be distinctly visible and identifiable: 

Approach light system 

The lights or markings of the threshold 

OR 

OR 

Visual references in BOTH paragraphs 91.I75(IK3)(iiXA) 
and | B) - 

The lights or markings of the touchdown 200 c 

(iKTXilM A» Th: runway threshold, identified by at least 
ooc of the following - 


•• beginning of the runway landing surface. 
•• threshold lights, or 
•• runway end identifier lights 


AND 


fl(3)fiiMB) The touchdown /ooc, identified by at least 
ooc of the following - 


•• runway touchdown zone landing surface. 
•• touchdown zone lights. 

•• touchdown zone markings, or 
•• runway lights. 



DO-515 establishes il>c minimum performance standards for an equivalent level of safety and performance to 
operate below the published DA'DH or MDA on a straight-in instrument approach procedure to 100 ft height above 
TDZE. With the challenge of developing equivalent levels of performance and safety, the results of three recent 
human-in the-loop experiments are analyzed to start a perfonnanee-based requirements development and to identify 
what research needs to be conducted to extend beyond this current operation and allow the use EV and/or SV 
technology to land and roll-out in all-weather and visibility conditions. 

3. G U I DANCE MATERIAL 

AC 1 20-29 A documents an acceptable means for obtaining approval of operations in Category I'll landing weather 
minima (Le., a DH lower than 200 ft but not lower than 100 ft and a rornvay visual range not less than 1200 ft). Part 
of the operation includes a '“natural vision segment;" that is. below live Dl l. the primary reference for maneuvering 
the airplane is based on what the pilot secs visually. 

AC120-28D describes an acceptable means for obtaining approval of operations in Category III landing weather 
minima (i.c.. Dlls below 100 ft. or no Dll and a runway visual range not less than 700 ft). Unlike ACI20-29A. 
ACI20-2KD does not include a natural visual segment. Consequently, with a goal of operating in Category III 
landing weather minima by use of SV and EV technology, a conundrum is created. Further operating credit for VS 
technology pushes into the AC120-28D weather and visibility arena but ACI20-28D docs not give consideration for 
a vision segment for the pilot. 

New criteria for all-weather landing and roll-out operations are needed for VS technology. The corollary for this VS 
technology is that of a landing in Visual Meteorological Conditions, not of operating an auto-land system. 

This paper evaluates previous experimental data for the goal of establishing the perfomtance-based standards which 
may meet these goals. 







For this operation, the pilot/flight crew is assumed to be flying a straight-in instrument approach procedure w ith 
published vertical guidance. This assumptioiv'restriction is imposed for three reasons. First, although truly 
“equivalent visual operations” are the ultimate objective of using this technology, the practicality is that initial work 
will open up lower landing minima for only a subset of operations, thus, only part of the complete EVO capability is 
explored for now. Second, safety of flight is improved using vertical descent guidance and must be promoted. The 
use of a continuous vertical descent trajectory fosters safe stabilized approach procedures. 16 Also, using v ertically 
guided approaches minimizes low altitude maneuvering since the intended landing runway and the intended 
touchdow n aim point should be at the bottom of the approach and live VS technology should confirm that fact. 
Lastly, by using a straight-in approach with published vertical guidance, the design of the approach adheres to 
Terminal Instrument Procedures: 1 thus, obstacle clearance and obstacle protection is inherently provided. As such, 
the VS should not have to provide obstacle clearancc'protection to enable lower landing weather minima. 

At this time, a VS is not intended to change the roles and responsibilities of Air Nav igation Serv ices Providers for 
spacing and separation from other traffic. The VS is also trot intended to change live roles and responsibilities of the 
airport services providers for foreign object damage control, w ildlife control, or other airport infrastructure and 
service functions. Future growth and usage of VS technology may enable the flight crew to self-separate from other 
traffic, terrain, and obstacles. 

Three experiments have recently been completed at NASA Langley Research Center (LaRC) evaluating certain 
aspects of F.V and SV technologies to support NextGcn all weather landing operations. The details of these 
experiments are not described Itcrein but are referenced. 

The three experiments were: 

• Crew and Display Concepts Ev aluation (CaD-CE) for Synthetic / Enhanced Vision" w 

• Synthetic Vision Systems - Operational Considerations (SVS-OC)" 

• external Visibility System (XVS) /All Weather Landing (AWxL) (XVSAWxLr 0 - 1 

The objectives of these three experiments were not specifically targeted toward the development of performance- 
based all-weather landing requirements, but they do provide piece-wise information toward this goal. Just as 
importantly, their assumptions and limitations identify areas of future research, as discussed in the following. 


4. LANDING AM) ROLL-OUT USING VISION SYSTEM TECHNOLOGY 
Below the D.VDH. the primary reference for maneuvering is based on what the pilot sees through the VS. What 
exactly is “seen." its performance, reliability and availability dictate live success of the operation. 

4.1 Visual References 


To descend below the published DA/DH. the VS sltould display the required “equivalent visual" references - 
continuously and distinctly visible and identifiable by the pilot. These visual references sltould be sufficient that 
they enable the pilot to manually fly the aircraft to (as per ACI20-28D): 

• “guide the airplane down the final approach segment to a touch down in the prescribed touch down zone” 

• “with an appropriate sink rate and attitude without exceeding prescribed load limits of the airplane” and. 

• "rollout to converge on and track the runway centerline, from the point of touch down to a sate taxi speed.” 

A missed approach/go-around is executed if the required v isual references are not continuously and distinctly visible 
and identifiable using the VS or if the aircraft is not in a position to land safely. 

The required "equivalent v isual" references for a VS landing can be assumed to be those of Table 1 which identifies 
the current-day natural visual references to successfully conduct this operation using natural vision. 

4.2 Head-L'n Display Reuuitemcnt 
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From ihe FAA's perspective. the use of a HUD was an essential "characteristic and feature" of the EFVS 
operation.* 2 These "essential features" of the HUD or equivalent display were described as follows: 

• The display sltould provide the EV image and spatially-referenced flight symbology so that they are aligned 
with and sealed to the external view (i.e.. conformally drawn). 

• The display slrould be located so the pilot is looking forward along the flight path (i.e.. looking at and 
through the imagery to the out-of-the window view) to readily enable a transition from EFVS imagery to lire 
out-the window view. 

• The display should not require tire pilot to scan up and down between a head down display of the image 
and the out-the-wiirdow view looking for primary flight reference information. This transition would 
otherwise be hindered by repeatedly re-foeusing from one view to the other. 

These HUD advantages are well founded in research.* '*” The HUD visual transition effects have even been shown 
in ground vehicle transportation studies.* Superior lateral touchdown performance has also been shown using a 
head-up display than head-down displays for a transition to visual references, although no improvement in 
longitudinal touchdown performance was show n.’" 

The perceptual and cognitive issues associated with HUDs (e.g.. attention capture) should not. however, be 
ignored. 2 * !v This issue was indirectly examined in the aforementioned NASA ground simulation tests. The Joint 
Aviation Authorities (JAA) Joint Aviation Requirement (JAR) All Weather Operations (AWO) performance-based 
approach standards were applied in an objective data analysisError! Reference source not found.". Specifically, 
the AWO standards specify that no more than 5% of the approaches will have localizer deviations greater than 'A dot 
or glideslope deviations greater than I dot between 300 ft and 100 ft HAT for certification acceptance. These low- 
visibility approach standards were not written specifically as quantitative performance standards for VS (e.g.. 
SVi’EV) operations, but were applied for comparative puiposes. 

The Continuous MethodError! Reference source not found, technique was used to calculate the probability of 
success. P(a). of meeting the AWO exceedance criteria |'/i dot localizer. I dot glideslope) with required levels of 
confidence for the HUD display concepts flown during the XVS'AWxL 31 *' and CaD-CE 1 * - ' 'experiments. 

The key differences pertinent to this analysis are that the CaD-CE experiment used a no-lowcr-than 100 ft HAT 
transition to out-the-window visual references (following the §91.175(1) and (m) EFVS operating rule) but the 
XVSAWxL experiment did not include this natural vision transition. The XVS'AWxL test was flown with the 
forward view obstructed, by reference only to an EV' image on the HUD. The side windows were unblocked and 
two conditions were experimentally varied: a) clear weather (i.e.. peripheral vision cues): and b) 200 ft runway 
visual range (i.e.. no peripheral vision cues). 

The probabilities of success for meeting the AWO localizer and glideslope criteria arc shown in Table II. broken 
down by the visibility conditions. The analysis revealed that: 

• 100% of the runs met the localizer criteria regardless of the visibility conditions. 

• During live XVS AWxL test (obstructed forward view). 78% of the runs with peripheral cues and 67% of 
the tuns without peripheral cues met the glideslope criteria. Having peripheral cues in the side windows 
appears to have enabled slight improvement in glideslope tracking performance ( 78% vs 67%). 

• In the CaD-CE experiment (with a visual transition no lower than 100 ft HAT), glideslope tracking was 
worse than either XVS/AWxL condition. Although the flight crews and experiment protocols were 
different, the comparison of the two experiments suggests that a slight improvement in glideslope tracking 
(60% vs. 67%i) may be realized with elimination of the visual segment during landing. 

The differences are not large and statistical significance for these differences cannot be deteimined. However, the 
trend makes intuitive sense. By allowing the pilot to concentrate on the task and display infotmation, improved 
flight tracking performance results. Tlie HUD-visual segment transition, although certainly improved over a head- 
down instrument to head-out visual transition, nonetheless, forces the pilots to simultaneously perform glideslope 
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corrections and acquire the required landing visual references through normal vision. 


The NASA ground simulations were conducted with a high fidelity, collimated out the-window visual simulation, 
but this attention switching 'transition phenomena should be evaluated and v erified in-flight. 


Table II. Probabilities of Success in Meeting the A WO Localizer and GUdeslope Criteria 


Experiment 

Peripheral Cue* 

I. localize r P|u) 

Glideslope P(a) 

Visual Landing Segment 

XVSAWxL 

Yes 

100 

7© 7 

No 

XVSAWxL 

No 

100 

67.4 

No 

CaD-CE 

Yes 

100 

60.0 

Yes 


4J Field-of-V'iew Criteria 


Because the VS operation is to mirror visual flight operations, one could argue that the cockpit window visibility 
required by the FARs. such as that defined under AC2S-773 would establish the field-of-vicw requirement. 

The overarching guidance within AC25-773 is that "the flight deek windshield must provide sufficient external 
v ision to permit the pilot to safely perform any maneuvers within the operating limits of the aircraft.” Two specific 
components are pertinent to the approach and landing phase. 

A "clear vision field” is defined "to meet the most important objective ... provide optimum vision for avoidance of 
midair collisions in "see and be seen" conditions of flight." For an EVO capability, this "clear vision field" will 
form a critical requirenKnt. How ever, for just landing operations, this "v ision polar” might be excessive. 

Two illustrations arc shown as examples. 

In Figurc I. the view forward of the pilot’s eye point is drawn using elevation and azimuth angles from the aircraft 
body axis reference. A portion of live "clear vision field" directly forw ard of the pilot is shown. This figure also 
sketches a "best case" HUD. assuming a 24 deg V x 32 deg H HUD ficld-of-vicw. w ith the lowest extend of the 
HUD meeting the 17 deg clear vision nose-down requirement. 

The HUD ficld-of-view does not cover the full extent of the "clear vision field.” The question is w hether this "clear 
v ision field" is required just for “see and be seen" or if its full extent is also a requirement if we are only concerned 
with approach and landing operation. 

Within the HUD ficld-of-view, this example si vows what prominent runway features would be displayed if an F.V 
system provided 2400 ft visibility from a 100 ft height above the TDZE point with the aircraft on a 3 degree 
glideslope to a 1000 ft mnway/glideslope intercept point without any erosswiivd. The illustration shows the 
symbolic horizon line, flight path marker and flight path reference symbol - all required references for an EFVS. 
Also displayed would be the last two light arrays of the Medium Intensity Approach Lighting System with Runway 
Alignment Indicator Lights (MALSR) |i.e.. the red circles in Figure 1). the runway threshold lights (i.e.. the green 
"plus” signs), and the runway edge lights at 200 ft intervals (i.e.. the black circles). A 2400 ft F.V range was 
assumed since it would be the minimum required EV visibility by rule to conduct an instrument approach to 
Category I minima. As this illustration shows, if these assumptions hold, live pilot should have a view of greater 
than the first 1400 ft of the intended landing runway touchdow n zone. 
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Figure I: Illustration ol Forward View froiu Aircraft wllh 2400 li Visibility In HUD 

With ihc aircraft in the same position as Figure I. this example is repeated but with only 1000 ft visibility (see 
Figure 2). In this case, it is also assumed that this is the prevailing visibility available to the pilot-monitoring (PM) 
viewing the approach looking out the forward window (i.e., (light visibility using natuiul vision, not enhanced flight 
visibility using EFVS). This example show s that, with 101)0 ft visibility, the PM can see the last tw o arrays of the 
MALSR lights and the runway thicshold lights. By the current $9I.I7S|I) and (in) EFVS rule, the requited runway 
references, as per Table I (i.e.. "the lights or markings of the threshold"), are visible using natural vision and the 
aircraft could proceed to landing. 
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Figure 2: Illustration of Forward Mew from Aircraft with HMH> ft Mobility 
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•i. l General Fjejd^>fcView Reguirement 


As noted in the Airplane Flying Handbook" “during the approach, round-out, and touchdown, vision is of prime 
importance.'' Research has attempted to quantity this but the exact visual mechanisms are many and varied. 11 

Depth perception is often cited as a factor in a successful flare, but research sltows that binocular cues from 
stereopsis and vcigcnce' 1 are of limited value in fixed-wing aircraft landing. Depth perception from monocular eues 
(e.g., perspective and occlusion) are more critical and are learned by pilots: thus, depth perception using the EV 
HUD conformal perspective presentation should not be significantly dilTercnt than using the out-the-window view. 

The ability of the pilot to successfully flare and touchdown is felt to be primarily dependent “on the angle at which 
the pilot's central vision intersects the ground (or ninway) ahead and slightly to the side."* 1 Tire pilot is assumed to 
use such visual cues as changes in runway or terrain perspective . Yet research" shows that “no dear research 
quantifying flow or classifying flow cues was found for aircraft landing.” 

The influence of visual cueing and reductions in fleld-of-view has been an active area of research since seemingly 
the dawn of aviation. Several studies w ere specifically conducted to address the feasibility and how much field-of- 
view is requited to safely conduct approach and landing operations using video imagery . These studies showed that. 

• Successful approaches could be performed and pilot performance was not adversely affected by 
ficld-of-vicw restriction down to 6" horizontal <H) x 30" vertical (V). The ficld-of-vicw 
restrictions were created by canopy masking. ToucImIowii perfoimanec was not significantly 
impacted by the field of view restrictions: how ever, pilot comments indicated that the task became 
increasingly diflleull and the smoothness of longitudinal control inputs was reduced with 
decreasing ficld-of-vicw. 1 With ficld-of-vicw restriction, pilots developed some “work-around” 
strategies to successfully fly with out-the-window-only infoimation. 

• Although pilots experienced some difficulty in flaring as accurately as desired, they were able to 
control a small aircraft through flare, landing, and roll-out using a 12 inch black-and-white 
monitor showing 21.5" V and H forw ard view."’ The primary difficulty reported was in estimating 
height during the last 10 feet from the runway. This diflieulty was thought to be due partly to the 
narrow ficld-of-vicw. which limited the peripheral vision, but mote strongly to the marginal 
resolution (only 7 to 1 1 arc minutes resolution) and depth of focus of the monitor. 

• A DC-3 aircraft was flown comparing ficld-of-vicw and video imagery. Wide angle (48°). normal 
(23'’). and telephoto (11") fields-of-vicw which, respectively, resulted in angular magnifications of 
0.34. 0.73, and 1.55 were flown using a monitor sltowing a subtended visual display angle of 
approximately 17." 1 These conditions were compared to flying with the pilot's outside vision 
restricted to only that seen through window masking providing approximately 20 degrees field-of- 
view. The data showed that it was possible to safely perform the landing task using the video 
displays, but the display mini fication magnification had a significant effect. The restriction of 
v ision to 20 degrees had very little effect on performance once the runway was in sight and the 
approach was initiated. In general, tire pilots felt that this ficld-of-vicw provided essentially the 
same information as tire normal full vision case. 

While dated, these studies highlight three critical principles: I) display resolution: 2) display nullification; (e.g.. 
conformality for equivalence to visual flight): and. c) field of view as small as -20" being the "equivalent” to the 
unrestricted visibility condition if tire image was collimated, confomral. and of eye-limiting resolution. Although 
not definitively concluded, these works suppoit the DO-315 field-of-view requirement (i.c.. 20") and suggest that 
this minimum may be acceptable, but perhaps not sufficient field-of-view for all-weather landing. 

4.5 Flare Cue 


A prominent concern for decreased horizontal field-of-view - although not necessarily supported by research - is that 
the lack of or restricted peripheral cues would adversely afl'cet the pilot's sink rate judgment and flare control. This 
concern was addressed in the earliest days of HUD use in commercial applications by introduction of the flare cue. 
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Some initial concern was; that tlie llaic cue might afl’ect the noimal perception and use of the visual landing cues but 
leamingi'training was expected to overcome any issues." Flight testing suggested that a flare cue was required, 
especially for w ide runways using a millimeter wave radar imaging sensor, since the runway edgelines wouldn't 
subtend sufficient visual angles for sink rate perception and Hare control. " But a recent study investigating HUD all 
weather landing capability showed that the Hare cue is unnecessary with an EV-equipped HUD sinec tlie pilots 
reported that they were "visual" using the EV imagery. Tire tlare cue was ignored. 1 " 

The presence or abseirce of peripheral cues was investigated during the XVS/AWxL experiment. The primary 
purpose was to investigate the interaction of periplrcral cues and collimated displays on landing using an XVS. In 
the full-factorial experiment design, this variation also tested the effect of peripheral cues on HUD landing, albeit 
w ithout any forward out- the- window visual cues other than the EV' HIJD. :U Tire presence or absence of peripheral 
cues did not create any operationally significant differences in pilot workload or situation awareness in tire flare and 
landing task. (Quantitative landing performance issues are discussed in Section 4.2). 

The XVS'AWxL experiment used a flare cue. Unbeknownst to the pilots, annunciated and unannunerated failures 
of the flare cue occurred at 60 ft and 35 ft altitude, respectively, on one EV' HUD tun for four pilots. The runs were 
flown w ithout peripheral cues. The EPs were trained on tire display changes that occurred for tire annunciated flare 
cue failure, but not for the unannurreiated one. 

The data showed that two of the four EPs verbally acknowledged the annurreiated flare cue failure 3.25 and 8.25 
second after the failures, respectively, and continued the approach and landed. The remaining two EPs did trot 
explicitly mention the failure but continued the approach to a landing. All four landings were w ithin the touchdown 
/one. In tire case of the unannunciated failure, none of tire four EPs explicitly acknow ledged the failure and each 
continued to a latrding. All unannunciated flare cue failure landings were within the touchdown /.one. 

These "non-normal" data suggest that the flare cue was not a powerful effect since 6 of 8 pilots didn’t acknow ledge 
a flare cue failure and performance degradation was not observ ed. 

An important distinction to mention is that a flare cue is not flare "guidance.” Under ACI20-28D. criteria for a 
manual Category III HUD capability is described. Flare guidance is described as a HUD symbol which the pilot 
manually tracks to land the aircraft, in the absence of natural or EV visibility, within the ACI20-28D required 
touchdown performance criteria. A flare cue. on tlie other hand, simply provides sink rate and altitude awareness 
analogous to a "rising runway” symbol, but does not provide specific direction to a touchdown landing /one. 

4.6 "3 Second" Rule for Field-of-View 


Item 4<d| within AC25-773 defines the "Landing Vision.” This rule seemingly originates from a conference in 
I963 41 with refinement during development work on supersonic transports 4 * to establish the visibility requirements 
for apptoach and landing. This so-called 3 second rule is in addition to the clear vision area as follows: 

"the view angle forward and dow n should be sufficient to allow the pilot to see a length of approach and or 
touch-down zone lights that would be covered in three seconds at landing approach speed w hen the aircraft is: 

( 1 ) On a 2 12 degree glideslopc. 

(2) At a decision height that places the lowest part of the aircraft at 100 feet above tlie touch- 
down zone extended horizontally. 

(3) Yawing to the left to compensate for ten knots crosswind. 

(4) Loaded to the most critical w eight and center of gravity. 

(5) Making the approach with 1200 feet runway visual range <RVR>.” 

The requirement is based on the perceived need of the flight crew/pilot to see some touchdown zone lighting for 
horizontal and vertical alignment for touelidown . For most aircraft, the 17 degree nose-low requirement contained 
in AC25-773 "clear vision area” supersedes this additional requirement. But for aircraft that fly at very high angles- 
of-attack like tlie Concorde, this rcquircnxmt drives the design of the w indow and forward fuselage in tlie absence of 
another means of compliance, such as an XVS. 
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This requirement was evaluated as part of the XVS/AWxL experiment by flying both high and low angle-of-atlack 
conditions (without altering the handling charactcristicsl The data suggests that the 3 second tule. despite its dated 
heritage, is v alid and should be met to provide landing line-up. control, and touchdown performance. 1 5 

4.7 Landing I'etfoimanee Criteria 

To begin the development of quantitative touchdown performance criteria. the NASA LaRC simulation daut ate 
examined. In each of the figures that follow, the "auto-land” quantitative performance criteria contained in AC 120- 
2 HD. Appendix 3 (200 to 2700 ft longitudinal. *7-58 ft lateral for the B-7S7 aircraft, and 10 ftp sink rate) are plotted 
for reference. (The side load and hank angle criteiia of ACI20-2SD were not considered in this work.) 

The CuD-CE experiment evaluated EFVS crew and display concept issues. Front the CaD-CE experiment, the 
longitudinal landing distance from the thieshold at touchdown is plotted in the top graph against the lateral distance 
from the centerline at touchdown and in the bottom graph against the sink rate at touchdown IT'D) in Figure 3. 
Only the nominal data are plotted li.e.. data from non-normal conditions are not plotted" "). The pitoi-flving (PF) 
u>ed an EV HI D in low visibility conditions (approximately 1000 to 2400 ft RVR) to manually land the simulated 
B-757 aiteruft. An autothiottle was set to “speed-hold” on the appiuach speed at 138 knots indicated airspeed 
(K1AS). using V„,*5 for the simulated landing weight. The pilots were instructed to disengage the autothroitle for 
landing. The glidcslope intercept was approximately KXK) ft from the threshold of the 1 1 .000 ft iximvay. 



Figure 3: Lateral and Longitudinal Touchdown Distance and Sink Rate Irom CaD-CE Experiment 

The XVSi'AWxL experiment evaluated an EV HUD concept without any forward oul-the- window visual cues other 
than the HUD. with and without peripheral cues from die side windows. From die XVS AWxL experiment, the 
longitudinal landing distance from the threshold at touchdown and tl»? lateral distance liom the centerline at 
touchdown aie plotted m Figure 4. In Figure 5, the longitudinal landing distance from the thieshold and the sink 
rate at TD are plotted. Only the nominal HUD data aie plotted, with and without peripheral cues. The PF used an 
EFVS HUD show ing approximately 4800 ft visibility with the forward view otherwise obscured to manually land 
the simulated B-757 aircraft. 1 " 11 An autothiottle was set to "speed-hold” at the approach speed of 132 KIAS. using 
V b ,-*5 for the simulated landing weight. The pilots were instiueted to disengage the autotluottle for landing. The 
glidcslope intercept w as approximately 1000 ft from the threshold of the 1 1.000 ft runw ay. 
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Figure 4: Lateral and Longitudinal Touchdown Distance from XVS/AWxL Experiment 



Figure 5: Sink Kate and Longitudinal Distance at Touchdown from XVS/AWxL Experiment 

The SVS-OC experiment evaluated the potential fot head-up and head-down SV concepts to support low visibility 
approach and landing operations. Below the DA Dll. the pilots were flying visually, w ithout aiding from SV 
imagery. As such, selected data are used from this experiment to create a baseline comparison to manually landing a 
B-757 uiterafi in ground simulation by use of HUD symbolic information alone, in Figure 6. the longitudinal 
landing distance from the thieslmld at touchdown is plorted in the lop graph against the lateral distance from the 
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centerline ut touchdown and in the bottom graph against the sink rate at T D. Only those configurations using the 
HUD and with a combination of approach and runway lighting and v isibility that is operationally rcitiftcd were 
used. From this experiment, these combinations were 3 nm visibility with minimum lighting. 2400 RVR with 
MALSR lights, and 1200 RVR and 2400 RVR with ALSF-2 lighting. 1 -' Only nominal data are shown. The PF 
manually landed the simulated B-757 aircraft following an instrument approach using SV on a HUD to a 100 ft or 
200 ft DA DH. An autothrottle was set to “speed-hold" at the approach speed of I3S KIAS. using V a ,+5 for the 
landing weight of the simulated B-757 aircraft. The pilots w ere instructed to disengage the autothrottle for landing. 
The ghdexlope intercept w as approximately 1000 ft from the threshold of the 1 IJ88 ft runw ay. 
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Figure ft: Lateral and Longitudinal Touchdown Distance and Sink Rate from SVS-QC Experiment 

The mean, standard deviation, maximum. and minimum values for these data are tabulated in Tables III through V 


■ able III: CaD-CE Touchdown Performance Statistics 



TD Longitudinal 
lotition (ft) 

T/D Lateral 
Potition (ft) 

T<D Sink Rate 
(R/kc) 

Mean 

1679.0 

•1.3 

•3.9 

Standard Dev 

531.5 

K.9 

ii 

Max. Value 

3618.0 

19.0 

•0.1 

Min. Value 

430.0 

•35.0 

• 10.0 


The data show several interesting trends. 

In all tests, the pilots were instiueted to fly as if they were catrying passengers in Putt 121 operations. All flight 
crew pilots were Air Transport Pilot (ATP)-rated. employed by a Pait 121 US carrier. The data show that with an 
EV HUD system or a v isual landing with a HUD. none of the landings were short of the AC 1 20-28 D landing 
performance criteria, all wete w ithin the lateral criteria, and the majority of the landings wete contained w ithin the 
longitudinal criteria. But some landed long. An important aspect of the AC120-28D criteria, is that these 
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performance bounds arc lo be met to a 10" probability lev el. None of tire experiments met the ACI20-28D criteria 
for lateral and longitudinal position at touchdown, but the lateral performance criteria is very close. 


Table IV: XVS/AWxL Touchdown Performance Statistics 



T'D Longitudinal Position (ft) 

JV# 

Peripheral Cites Peripheral Cue. * 

T/D Lateral Position (ft) 

So 

Peripheral Cue* Peripheral Cues 

T.*I) Sink Rate (fl'xec) 

So 

Peripheral Cues Peripheral Cues 

Mean 

SUmlird Dev. 

1708.4 1664. 1 

-2.1 -4.0 

-5.9 -5.4 

522.5 

584.1 

I2.S | 12.0 

2.3 

1.9 

Max. Value 

2987.2 3216.8 

26.0 29.3 

• 1.9 -1.2 | 

Mm. Value 

700.6 

706.1 

•37.3 | -30.8 

-11.4 

-10.1 


Analysis of the sink rate data against tire ACI20-28D requirements has not yet been conducted but cursory 
examination suggests that this manual landing performance will not meet an auto-land perfomianee criteria either. 
Experience in ground simulation suggests that sink rate control, in particular, is significantly degraded over actual 
flight performance. In flight, sink rate is much better controlled, whereas, in simulation, higher sink rates are 
experienced. 11 This observation needs to be substantiated with HUD VS operations. 


Table V: SVS-OC' Touchdown Performance Statistics 



T/D Longitudinal 
Position (ft) 

T/D Lateral 
Position (ft) 

TfD Sink Rate 
<n/s«> 

Mean 

1595.6. 

5.7 

•4.7 

Standard Dev. 

494.1 

12.1 

2.23 

Max. Value 

3123. 

39. 

0.4 

Mm. Value 

462. 

-29. 

-14.4 


To meet the AC120-28D longitudinal and lateral criteria, assuming normally distributed data, requires a mean 
touchdown longitudinal position of 1450 ft and a standard deviation of 256 ft and a zero mean for lateral position 
from centerline and a standard deviation of 12 ft. respectively. The data shown in Tables lll-V indicate that the 
standard deviation data for lateral position very nearly meets the auto-land standard, but live longitudinal touchdown 
position data shows a mean distance fanher past tire threshold and with a higher standard deviation. (Note that the 
SVS-OC and XVS'AWxL longitudinal and lateral touclkdown data met tests for normally distributed data, the CaD- 
CE longitudinal and lateral touchdown data were slightly skewed from a normal distribution.) 

The data suggests that manual control of an aircraft to touclkdown cannot be performed as precisely as automation. 
This result is neither surprising nor is it unexpected. Research has shown time-and-time again, that while human 
performance can at times meet and exceed the performance of automation, automation provides better performance 
over the long run since it doesn’t fatigue, lose focus and attention, or need to sleep or eat. But. more importantly, 
the human operator employs the most adaptive controller ever invented, which can cope with ever-changing, 
unexpected, or unique circumstances under which automation might, otherw ise, catastrophically fail. 

One might argue that if VS technology is not held to tl>e AC120-28D perfonnanee requirements, safety might be 
compromised. A study was conducted to evaluate the feasibility of determining the relative differences in 
touchdow n sink rate statistics between manual and automatic landings for the purposes of structural maintenance. 4 ' 
Data measured on in-service Airbus 320 aircraft under the Airborne Data Monitoring Systems were analyzed. The 
T.D sink rates were less for manually flown landings than for autoland conditions. It was felt that pilots tried to 
minimize the sink rates for passenger comfort. 




























More interesting is the faet that of the 15.047 landings recorded for this study, only 123 were automatic. Less than 
1% of the landings were flow n with an autoland system. While this statistic reflects of the relative lack of Category 
Il'IlI weather requiring an autoland, it is also indicative of the ability of airline pilots to safely hand-fly an aircraft to 
landing. Tire outstanding Part 121 safety record is clearly home out by this manual landing performance. So while 
the safety record of an autoland system cannot be discredited, the perfonnanec of manual flight is unrivaled and 
performance criteria based on manual control is safe and appropriate for performance-based VS technologies. 

4j Longitudinal Touchdown Performance Requirements fot Vision System Technology 

The implication for performance-based requirements development is that existing Category III auto-land 
requirements are neither relevant nor applicable to VS technology. This is not to say that landing performance isn’t 
important. But the precision and repeatability of the autoland for touchdow n performance isn’t necessary since the 
human pilot can consider numerous factors into the landing - such as passenger comfort and runway conditions - to 
execute safe landings. The pilot can also monitor for a bad approach, given sufficient cues. aird go-around. unlike 
an autoland. In fact, the FARs specifically call out that an appropriate missed approach procedure sltould be 
immediately executed if the pilot were unable to control the descent rate of the aircraft to allow touchdown to occur 
within the touchdown zone <TDZ) of tire intended landing runway. 

The TDZ is defined as the first 3000 ft or the first third of the runway, whichever is more restrictive. The 
longitudinal touchdown data from the three NASA ground simulation experiments show that all touchdowns were 
within this TDZ requirement, except for 1 1 out of 678 landings - less than 2% of the landings. 

Theie arc four confounds or caveats in apply ing these data for substantiation of “true" VS performance: 

1. Not all of the subject pilots were trained in flying a Boeing 757 aircraft. Tire subject pilot recruitment 
criteria was principally their experience in HUD operations and their status - holding an ATP rating w ith a 
US air carrier, not their aircraft type rating. 

2. Very high approach speeds were flown, with a simulated B-757 aircraft near its maximum landing weight. 

3. The pilots were not briefed specifically that they must adhere to the TDZ landing requirement as specified 
within the CFRs. This requirement was implied. 

4. All approaches were manually flown and the autothrottles were set to speed hold. Because of aircraft 
experience and training differences, not all pilots were familiar with the operation of the simulator’s 
autothrottle speed hold function and the faet that they had to manually disconnect tire autothiottles and pull 
back the throttles to flight idle for good flare performance. In many instances, the pilots forgot to 
disconnect the autothrottles and tire speed didn’t bleed off. resulting in a floating tendency . 

Two alternative requirements are evaluated as potential longitudinal touchdown performance criteria for VS 
technology. 

In tire first alternative, the capability for a go-around by the pilot in the event that they were unable to control the 
descent rate of tire aircraft to allow touchdown to occur within the TDZ of the intended landing runw ay is accepted. 
Under tire JAR AWO requirements, a go-around rate below 500 ft attributable to the landing system perfomrance or 
reliability may not be greater than 5%. This requirement is primarily based on the implications of air traffic 
management in handling a large number of aircraft going missed. Instead, it’s assumed that the go-around rate 
attributable to the VS sltould meet aird exceed this requirement, but by an order of magnitude. A proposed 
alternative eould be that no mote than 5 in 1000 VS landings sltould result in a go-around. The alternative criterion 
would be that the landing system perfomrance sltould demonstrate. 

1 . a longitudinal touchdow n earlier than a point on the runway 0 ft. from the threslrold to a probability of 5 x 
I 0 J ; and. 

2. a longitudinal touchdown beyond 3000 ft. from threshold to a probability of 5 x 10 
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This proposed requirement could be met. if tire mean T'D point w ere 1500 ft from the threshold, w ith a standard 
deviation of no more than 5 <4 ft (assuming normally distributed data). This distribution of TO position looks like a 
more reasonable approximation to that observed in the NASA simulation tests for manual control of landings 
(Tables III-V). Applying the touchdown data from the three NASA experiments to this alternative criteria shows 
that the SVS-OC data would meet this alternative criterion, but the XVS'AWxL and CaD-CE experiment data fall 
slightly outside. 

Another concept for a performance-based touchdown criteria is proposed from aircraft developmental and 
certification flight testing procedures. In AC25-7. the procedures for determining an aircraft's landing distance are 
described. The landing distance is the horizontal distance from the point at which the main gear of the airplane is 50 
ft above the landing surface | treated as a horizontal plane through die touchdown point) to the point at which the 
airplane is brought to a stop. The distance is treated in two parts of which the "air distance” the distance from a 
height of 50 ft to touchdown is of interest. Several mctltods are proposed for determining the "air distance." The 
AC indicates that 40 landings usually establish satisfactory confidence levels for the data. This landing distance is 
used in the Aircraft Flight Manual for landing performance data. 

The air distance data from the three NASA experiments is shown in Table VI. The data show that the air distance 
exhibits much less scatter than landing distance (as measured by the standard deviation). The air distance numbers 
reflect the pilot’s ability to control the airspeed, its bleed-off. and flare the aircraft to touchdown w ith an acceptable 
sink rate. Tire longitudinal landing position values include these factors as well as introduces an additional 
variability from the imprecision of pilot control to precisely crossover the threshold at the designated threshold 
crossing height (TCH). The "rule-of-thumb" (e.g.. sec AC91-79. "Runway Overrun Protection”) is that 200 ft of 
additional landing distance results from every 10 feet above tire TCH. Tire landing distance performance 
requirements arc mostly influenced by precise control of the TCH and speed performance at tire TCH and through 
the flare''" 1 These factors, unfortunately, were trot controlled variables in the NASA experiments and additional 
testing is warranted to assess their influence in VS technology. 


Table VI: Air Distance Statistics 



CftD-CE 

Experiment 

XVSAWxl. Experiment 
Xo 

Peripheral Cuts Peripheral Cuts 

SVS-OC 

Experiment 

Mean 

2814.1 

1750.2 

1745.8 

1658.1 

Standard Dev. 

460.0 

398.0 

| 391.1 

411.7 

Max. Value 

4646.4 

30764 

2669.0 

2873.4 

Min. Value 

IS46.5 

1017.1 

891.3 

557.3 


5. CONCLUDING REMARKS 

Recent research in S’EV technology is analyzed with respect to existing Category 11/111 performance and 
certification guidance. The goal is to start the development of performance-based vision systems technology 
requirements to support future all-weather operations and the NextCien goal of Equivalent Visual Operations. This 
work shows that existing criteria to operate in Category III weather and visibility arc not directly applicable since, 
unlike today, the primary reference for maneuvering the airplane is based on what the pilot sees visually through the 
VS. New criteria are consequently needed. 

Research indicates that a minimum HUD flcld-of-vicw of 20 degrees is roughly equivalent to normal, unobscured 
vision for the approach and landing task, if the confoimal HUD information is of sufficient resolution and clarity. A 
flare cue is typically included with comnKrcia! HUD symbology but flare cue criticality has not been substantiated. 
Since an EFVS should provide suflieient forward vision, landing by use of the flight path marker and imagery 
should obv iate the need for a flare cue. 


15 











Pilot- in- thc-loop ground simulation testing documents the expected landing system touchdown performance by use 
of VS technology. However, these data are colored by several factors which were immaterial to the primary goals of 
the experiments, but arc germane to this performance-based requirements development. Possible criteria are 
discussed, but more importantly, live factors associated with landing system performance using automatic and 
manual landings are delineated. Additional work is needed to refine and validate performance-based VS 
requirements for all-weather landing, and the influence of factors associated with manual control for flare and 
landing. 
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